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I. Basis of the report 



1 . With regard to the elements of the international application:* 
| | the international application 1 as originally filed, 
the description: 

pages MO as originally filed 

pages NONE , filed with the demand 

pages NONE , filed with the letter of . 

the claims: 

pages NONE as originally filed 

pages none , as amended (together with any statement) under Article 1* 

pages 41-55 , filed with the demand 

pages NONE , filed with the letter of _ 

the drawings: 

pages 1^9 t as originally filed 



pages NONE , filed with the demand 

pages NONE , filed with the letter of * 

| | the sequence listing part of the description: 

pages NONE L as originally filed 

pages NONE , filed with the demand 

pages NONE , filed with the letter of ■ 

With regard to the language, all the elements marked above were available or furnished to Ais Authonty in the 
language in which the mtemational application was filed, unless otherwise ^ indicated under this item 
These elements were available or furnished to this Authority in the following language which is. 

□ the language of a translation furnished for the purposes of international search (under Rule23.1(b)). 
| | the language of publication of the international application (under Rule 48.3(b)). 

□ the language of the translation furnished for the purposes of international preliminary examination(under Rules 
55.2 and/or 55.3). . 

3 With regard to any nucleotide and/or amino acid sequence disclosed in the mternational application, the 
international preliminary examination was carried out on the basis of the sequence listing: 
| | contained in the international application in printed form. 
| | filed together with the international application in computer readable form. 
| | furnished subsequently to this Authority in written form. 
| | furnished subsequently to this Authority in computer readable form. 

□ The statement that the subsequently furnished written sequence listing does not go beyond the disclosure in the 
international application as filed has been furnished. 

□ The statement that the information recorded in computer readable form is identical to the written sequence listing 
has been furnished. 

4. The amendments have resulted in the cancellation of: 

"Jl the description, pages NONE 
| the claims, Nos. NONE 
| the drawings, sheets/fig NONE 
5 □ This report has been established as if (some of) the amendments had not been made since they have been considered to go 

' beyond the disclosure as filed, as indicated in the Supplemental Box (Rule 70.2(c)). 
* Replacement sheets vhich have keen furnished to the receiving Office in ™£°™*^ 

this reoort as "orisinally filed" and are not annexed to this report since they do not contain amendments ^ uLes J^ i0 ana /u ' 
t iny r eplaceZeS such amendments must be referred to wider item 1 and annexed to this report. 
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V. Reasoned statement under Rule 66.2(a)(ii) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 

1. STATEMENT 



Novelty (N) 



Claims 1-59 



Claims NONE 



.YES 
NO 



Inventive Step (IS) Claims YES 

Claims NONE NO 

Industrial Applicability (IA) Claims U59 YES 

Claims NONE _____________ NO 



2. CITATIONS AND EXPLANATIONS 

Claims 1-59 meet the criteria set out in PCT Article 33(2)-(3), because the prior art does not teach or fairly suggest 
comparing the composite reference information to information pertaining to the same feature for respective one for a 
plurality of media objects in a collection of media objects to identify one or more media objects wherein a non-Euclidian 
function is used either to combine the information pertaining to the feature, or compare the composite reference 
information to information pertaining to the same feature as recited in independent claims 1, 29, and 57. These 
limitations, in combination with the other limitations of the claims, were not disclose by, nor would not have been 
obvious over, nor would have been fairly suggested by the prior of record. 

The dependent claims 2-27, 30-55, and 58, being further limiting to the independent claims 1, 28, and 57, definite and 
enabled by the specification meet also the criteria set out in PCT Article 33(2)-(3). 

Regarding independent claims 28, 56, and 59, the prior art does not teach or fairly suggest comparing the 
composite reference information to information pertaining to the same feature for each respective one of a plurality of 
the media objects in the collection of media objects, wherein comparing includes comparing the composite vector to the 
feature vector of each media object in the collection of media objects using a Min or Max function and assigning a 
similarity value to each media object in the collection media objects, where the siniilarity value of each of the media 
objects in the collection is less than or equal to the similarity value calculated for each reference object. 



NEW CITATIONS 
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5 What is claimed is: 
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1. A method for searching a collection of media objects, comprising: 

combining object information for a plurality oi reference objects to produce 
composite reference information representing criteria for a search; and 
comparing the composite reference information to object information for 
media objects in a collection of media objects to identify one or more 
media objects in the collection jpf media objects. 



2. The method of claim 1, further comprising: 
15 receiving user input specifying/the plurality of reference objects. 



20 



3. The method of claim 1, further comprising: 

selecting a media object in the collection of media objects based upon the 

/ 

comparison of the objept information and the composite reference 
information. 



25 



4. The method of claim 1 , wherein: 

the plurality of reference objects includes one or more objects having a type 
selected from: audio, image, text, CD, or video. 

5. The method of claim 4, wjherein: 

combining object information for a plurality of reference objects includes 
combining object information for different types of objects. 



41 
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6. The method of claim 1, wherein: / 

combining object information for a plurality of reference objects to produce 
composite reference information includes determining the intersection of 
the object information for the reference objfects. 




10 7. The method of claim 1, wherein: 

combining object information for a plurality of reference objects to produce 
composite reference information indudes determining the union of the 
object information for the reference objects. 



15 8. The method of claim 1 , wherein: 

the object information characterizes features of the reference objects and the 
media objects in the collectionjof media objects. 

9. The method of claim 8, wherein: 
20 the object information is weighted to specify a relative importance of the 

features. 



25 



10. The method of claim 8, further comprising: 



receiving user input indicating the relative importance of the features. 



1 1 . The method of claim 8, wherein: 

at least one feature is represented by the relative frequency of occurrence of 

n 

each of several values for<the feature. 



or<u 

J 
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12. The method of claim 8, wherein: 

the set of features includes color information^ describing the relative frequency 
of occurrence of colors in an object. 



13. The method of claim 8, wherein: 

a feature for a first object type is mappfed to a feature for a second object type. 

14. The method of claim 1, further comprismg: 

combining object information for an additional reference object with the 
composite reference information to revise the composite reference 
information. 



15. The method of claim 14, wherein: 

the additional reference is a me'dia object identified by comparing the 

I 

composite reference information to object information for media objects. 



16. The method of claim 14, furtherjcomprising: 

comparing the revised composite reference information to object information 



for media objects in the 



collection of media objects. 



17. The method of claim 1, wherein: 

comparing the composite reference information to object information for 
media objects in a collection of media objects includes assigning a 
similarity value to each of the media objects in the collection of media 



43 



3* 



WO 2004/031991 



PCT/US2002/031258 



objects, the similarity value indicating the similarity of the object to the 
composite reference information.. 



10 



18. The method of claim 17, wherein: 

the similarity value of each of thfe media objects in the collection of media 
objects is less than or equa/ to a similarity value calculated for each 
reference object. 



15 



20 



25 



19. The method of claim 17, lurthpr comprising: 

ranking the media objectsf according to their similarity values; 
wherein selecting a media object in the collection of media objects based upon 
the comparison of the object information and the composite reference 
information includes selecting a media object based upon its rank. 



20. The method of claim 8, wherein: 

the object information for each of the reference and media objects is expressed 

as a feature vector of components; and 
each feature vector jncludes one or more components representing a feature of 

the corresponding reference or media object. 



21. The method of claim 20, wherein: 

combining object information for a plurality of reference objects includes 
combining the feature vectors of the plurality of reference objects to 
produce a composite reference vector. 4 kC^^ ^ ^ 
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22. The method of claim 21, wherein: 

each feature vector includes one or more components representing metadata 

associated with the corresponding reference or media object; and 
combining object informationffor a plurality of reference objects includes 
combining components representing a feature of part or all of each 
reference object according to a first combination function and combining 
the one or more components representing metadata associated with part or 
all of each reference object according to a second combination function. 



15 



23. The method of claim 21, ntftner comprising: 

defining a weighting vector for one or more of the features, the weighting 
vector specifying ^relative importance for the corresponding features; 

wherein combining the feature vectors includes using the weighting vector to 

f 

specify a relative importance of the features. 



25 



20 24. The method of claim 2 1 J wherein: 

combining the feature vectors includes using a Min or Max function. 



25. The method of claim 2l| wherein: 

i 

comparing the composite reference information to object information for 
media objects ink collection of media objects includes comparing the 
composite reference vector to the feature vectors of each of a plurality of 
media objects in t|ie collection of media objects. 



26. The method of claim 25, wherein: 
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5 comparing the composite reference vector to the feature vectors of each of a 

plurality of media objects includes using a Min or Max function. 

27. The method of claim I, wherein:! 

combining object information for a plurality of reference objects includes 
1 0 using a combination function; 

comparing the composite reference information to object information for 

media objects in a collection of media objects includes using a comparison 
function that is based' upon the combination function. 



15 



20 



25 



28. The method of claim 1, wherein: 

i 

the object information characterizes features of the reference objects and the 



media objects in the collection of media objects and is expressed as a 
feature vector of components; 
combining object information for a plurality of reference objects includes 



combining the feat 
Min or Max functi 



ire vectors of the plurality of reference objects using a 
>n to produce a composite reference vector; 
comparing the composite reference information to object information for the 

media objects in the collection of media objects includes comparing the 
composite reference vector to the feature vectors of each media object in 
the collection of media objects using a Min or Max function and assigning 
a similarity value to*each media object in the collection of media objects, 
the similarity value indicating the similarity of the feature vector of the 



maicatir 

\ 



media object to the composite reference vector, where the similarity value * 
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of each of the media objects in me collection of media objects is less than 
or equal to a similarity value calculated for each reference object. 



29. A computer program product on a computer-readable medium, for searching a 

10 collection of media objects, the computer program comprising instructions 

operable to cause a programmable processor to: 

combine object informationffor a plurality of reference objects to produce 

composite reference inrormation representing criteria for a search; 

compare the composite reference information to object information for media 

1 5 objects in a collection of media objects to identify one or more media 

I 

objects in the collection of media objects. 



30. The computer program product of claim 29, further comprising instructions 
operable to cause a programmable processor to: 
20 receive user input specifying the plurality of reference objects. 



3 1 . The computer program product of claim 29, further comprising instructions 
operable to cause a programmable processor to: 

select a media object in the collection of media objects based upon the 

I 

25 comparison of the object information and the composite reference 

information. 
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the plurality of reference objects includes one or more objects having a type 



ye 



selected from: audio, image, text, CD, or video 



33. The computer program product of claim 32, wherein: 

instructions to combine object information for a plurality of reference objects 
include instructions to combine object information for different types of 
objects. 



34. The computer program product of claim 29, wherein: 

/ 

instructions to combine object information for a plurality of reference objects 
to produce composite reference information include instructions to 

/ 

determine the intersection ofjthe object information for the reference 
objects. 



35. The computer program product offclaim 29, wherein: 

instructions to combine objecf information for a plurality of reference objects 
to produce composite reference information include instructions to 
determine the union of thl object information for the reference objects. 



36. The computer program product o'f claim 29, wherein: 

the object information characterizes features of the reference objects and the 
media objects in the collection of media objects. 



37. The computer program product oficlaim 36, wherein: 



O 
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38. The computer program product of claim 36, further comprising instructions 
operable to cause a programmable processor to: 
10 receive user input indicating the relative importance of the features. 



15 



39. The computer program product of claim 36, wherein: 

I 

at least one feature is represented by the relative frequency of occurrence of 
each of several values for the feature. 

40. The computer program product of claim 36, wherein: 

the set of features includes color information describing the relative frequency 
of occurrence of colors in an object. 



20 41 . The computer program product of craim 36, wherein: 

a feature for a first object type islmapped to a feature for a second object type. 



25 



42. The computer program product of claim 29, further comprising instructions 

1 

operable to cause a programmable processor to: 
combine object information for an additional reference object with the 



composite reference information|to revise the composite reference 
information. 



43. The computer program product of claim 42, wherein: 
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5 the additional reference is a media object identified by comparing the 

composite reference information to objectfinformation for media objects. 



10 



44. The computer program product of claim 42, further comprising instructions 
operable to cause a programmable processor to: 
compare the revised composite reference information to object information for 
media objects in the collection of media objects. 



15 



45. The computer program product of claim 29, wherein: 

instructions to compare the composite reference information to object 

/ 

information for media objects in a collection of media objects include 
instructions to assign a similarity value to each of the media objects in the 
collection of media objects! the similarity value indicating the similarity of 
the object to the composite reference information. 



20 46. The computer program product <yf claim 45, wherein: 

the similarity value of each df the media objects in the collection of media 
objects is less than or eqfial to a similarity value calculated for each 
reference object. 

25 47. The computer program product of claim 45, further comprising instructions 
operable to cause a prog -ammable processor to: 
rank the media objects according to their similarity values; wherein 

object in the collection of media objects based 



i 

instructions to select a medis 



upon the comparison of the object information and the composite referenced * 
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information include instructions to select a media object based upon its 
rank. 



48. The computer program product claim 36/wherein: 

the object information for each of the reference and media objects is expressed 
as a feature vector of components; and 



each feature vector includes one or more components representing a feature of 

I 

the corresponding reference of media object. 



49. The computer program product of cjaim 48, wherein: 

instructions to combine object information for a plurality of reference objects 
include instructions to combine the feature vectors of the plurality of 
reference objects to produce a composite reference vector. 

I 

50. The computer program product of Maim 49, wherein: 

each feature vector includes one or more components representing metadata 
associated with the corresponding reference or media object; and 



combining object information for a plurality of reference objects includes 

I 

combining components representing a feature of part or all of each 
reference object according to a first combination function and combining 

I 

the one or more components>representing metadata associated with part or 

\ 

all of each reference object according to a second combination function. 

\ 

51. The computer program product of claim 49, further comprising instructions 

\ " A 

operable to cause a programmable processor to: 
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define a weighting vector for one or more of the features, the weighting vector 
specifying a relative importance for the corresponding features; 

wherein instructions to combine tip feature vectors include instructions to use 
the weighting vector to specify a relative importance of the features. 

52. The computer program product of claim 49, wherein: 

instructions to combine the feature vectors include instructions to use a Min or 
Max function. 



53. The computer program product offclaim 49, wherein: 

instructions to compare the composite reference information to object 
information for media objjfcts in a collection of media objects include 
instructions to compare the composite reference to the feature vectors of 
each of a plurality of medik objects in the collection of media objects. 



54. The computer program product offclaim 53, wherein: 

I 

instructions to compare the composite reference vector of the reference object 
to the feature vectors of each of a plurality of media objects include 

I 

instructions to use a Min or Max function. 



55. The computer program product of claim 29, wherein: 

instructions to combine object information for a plurality of reference objects 

include instructions to use a combination function; 
instructions to compare the composite reference information to object 

information for media objects in a\ollection of media objects include 
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instructions to use a comparison' function that is based on the combination 
function. ; 

56. The computer program product of claim 29, wherein: 

? 

the object information characterizes features of the reference objects and the 

'i 

media objects in the collection of media objects and is expressed as a 

f 

feature vector of components; 

it 

combining object information for ^.plurality of reference objects includes 

i 

combining the feature vectors of the plurality of reference objects using a 
Min or Max function to produce a composite reference vector; 



comparing the composite reference information to object information for the 

... ! 

media objects in the collection of media objects includes comparing the 

i 

composite reference vectoi|to the feature vectors of each media object in 

the collection of media objects using a Min or Max function and assigning 

1 

a similarity value to each media object in the collection of media objects, 

I 

the similarity value indicating the similarity of the feature vector of the 
media object to the composite reference vector, where the similarity value 



of each of the media objects in the collection of media objects is less than 
or equal to a similarity value calculated for each reference object. 



57. A system for searching a collection of media objects, comprising: 

means for combining object information for a plurality of reference objects to 

produce composite reference information representing criteria for a search; 
and 
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5 means for comparing the composite/reference information to object 

information for media objects in a collection of media objects to identify 

/ 

one or more media objects in the collection of media objects. 

58. The system of claim 57, wherein: | 

a 
j 

10 means for comparing the composite reference information to object 

information for media objects in the collection of media objects includes 
means for assigning a similarity value to each of the media objects in the 

collection of media objectsf the similarity value indicating the similarity of 

£ 

I 

the object to the composite|reference information, wherein the similarity 
15 value of each of the media jpbjects in the collection of media objects is less 

than or equal to a similarity value calculated for each reference object. 

59. The system of claim 57, wherein: 

the object information characterizes features of the reference objects and the 

t 

20 media objects in the collection of media objects and is expressed as a 

! 

feature vector of components; 



means for combining object information for a plurality of reference objects 

I 

includes means for combining the feature vectors of the plurality of 



reference objects to produce ajcomposite reference vector; and 



25 means for comparing the composite reference information to object 

% 

information for media objects in, a collection of media objects includes 



30 



means for comparing the composite reference vector to the feature vectors 

\ 

of each of the media objects in the collection of media objects. 

. \ «ssa 



